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We study the magnetic phase diagram of spin-| fermions in a spatially anisotropic square optical 
lattice at quarter filling (corresponding to one particle per lattice site). In the limit of the large on- 
site repulsion the system can be mapped to the so-called Sp(N) Heisenberg spin model with N — 4. 
We analyze the Sp(N) spin model with the help of the large- N field-theoretical approach and show 
that the effective theory corresponds to the Sp(N) extension of the CP N_1 model, with the Lorentz 
invariance generically broken. We obtain the renormalization flow of the model couplings and show 
that although the Sp(N) terms are seemingly irrelevant, their presence leads to a renormalization 
of the CP N_1 part of the action, driving a phase transition. We further consider the influence of 
the external magnetic field (the quadratic Zeeman effect), and present the qualitative analysis of 
the ground state phase diagram. 



PACS numbers: 03.75.Ss,67.85.-d,67.85.Fg,64.70.Tg 

I. INTRODUCTION 

Extraordinary controllability of ultracold gases allows 
highly accurate modeling and study of problems origi- 
nated in condensed matter physics. Frustrated magnetic 
systems occupy an important position on the list of in- 
triguing problems that could be studied in multicompo- 
nent ultracold gases. Recently, multicomponent ultra- 
cold Fermi gases have attracted much attention-^ moti- 
vated by the growing availability of hyperfine-degenerate 
fermionic atoms, such as 6 Lif2r— 40 Kj£ 135 Ba and 137 Ba, 7 
and 173 Ybf£ Realization of unconventional phases of 
SU(N) internally frustrated antiferromagnets^ have been 
recently suggeste d 10 ' 11 in alkaline earth atoms with nu- 
clear spin as large as | in 87 Sr. 

Among multicomponent ultracold gases, spin-| alka- 
line fermions stand out by their rich physics charac- 
terized by an enlarged Sp(4) symmetry, which is nat- 
urally present in the system without fine-tuning of any 
parameters* 1 ^ By tuning the ratio of scattering lengths 
in the two allowed spin-0 and spin-2 channels, even the 
larger SU(4) symmetry may be achieved*^— 

Experiments with ultracold atoms are usually done 
in the presence of magnetic fields. For atoms with hy- 
perfine spins F > 1, the spin-changing collisions redis- 
tribute the populations of the components with different 
spin projection F z while keeping the total magnetization 
M = J^j Fj fixed. Therefore, the usual linear Zeeman 
effect induced by an external magnetic field does not play 
any role for a state with a fixed initially prepared M, and 
the main influence of an external magnetic field (except 
the change of scattering lengths due to the Feshbach res- 
onance phenomenon) is contained in the quadratic Zee- 
man effect (QZE). The quadratic Zeeman field q couples 
to ^2j(Fj) 2 and thus introduces a difference in chemical 
potentials for components with different \F Z \. A pecu- 
liar property of spin-| fermions is the fact that even in 
presence of the quadratic Zeeman field, the high Sp(4) 



symmetry is lowered to SU(2) x SU(2) and thus remains 
quite highJ^ 

In this work, we study the magnetic phase diagram 
of spin- 1 fermions at quarter filling, in the limit of a 
strong on-site repulsion, on an anisotropic square lattice 
with hopping amplitudes in two spatial directions differ- 
ing by the factor A € [0,1], as depicted in Fig. Q] We 
construct the effective field theory describing the low- 
energy properties of the system which has the form of a 
Sp(N) extension of the CP^ -1 model, with the gener- 
ically broken Lorentz invariance. For this field theory, 
the analysis of the one-loop renormalization group equa- 
tions shows that the Sp(N) terms are dangerously irrele- 
vant: their presence leads to a considerable renormaliza- 
tion of the CP^ -1 part of the action. As the result, by 
changing the ratio of the scattering lengths or the lattice 
anisotropy parameter A one can drive the phase transi- 
tion between the long range ordered Neel state and the 
valence-bond-solid (VBS) state. 

We also include into consideration the quadratic Zee- 
man coupling and study the evolution of the ground 
state under QZE. Since the QZE preserves the SU(2) 
symmetry^ the ground state at large values of the 
quadratic Zeeman field q corresponds to the long-range 
ordered (Neel) phase of the isotropic spin- 1/2 Heisenberg 
antiferromagnet (HAFM), for any nonzero value of the 
lattice anisotropy parameter A / 0. We show that, de- 
pending on the value of the anisotropy A, when the field 
q is decreased, this state either adiabatically evolves into 
the Neel phase of 4-component fermions or undergoes a 
phase transition into the VBS state. 

The structure of the paper is as follows: in Sect. |TT] 
we present the derivation of the low-energy effective field 
theory for a system spin-| fermions at quarter filling in 
the regime of a Mott insulator (in other words, in the 
regime of the Sp(A) Heisenberg model). In Sect. Hill we 
analyze the renormalization group flow of the derived 
model and sketch the phase diagram of the system in 



2 



dimensions one and two. In Sect. HVI we study the effect 
of an external quadratic Zeeman field; finally, Sect. [V] 
contains the summary and discussion of the results. 



II. EFFECTIVE LOW-ENERGY FIELD THEORY 
FOR THE Sp{N) HEISENBERG MODEL 

Consider a system of spin-| fermions on a two- 
dimensional anisotropic square lattice. In the s-wave 
scattering approximation, this system can be described 
by the following Hamiltoniani^ 

H=- J2 EM4,^+h.c.) 

<7=±l/2,±3/2 (ij) 
F 

+ EE^ E P Fm,i P Fm,i> W 
i F=0,2 m=-F 



where c a ,i are the spin-| fermionic operators at 
the lattice site i, tij are the effective hopping am- 
plitudes between two neighboring sites, PFm,i = 
Scrcr'^' 71 !!' 7 ' ^° J ) c a,i c <r',i are the operators describing 
an on-site pair with the total spin F, and the posi- 
tive interaction constants Uq, U 2 are proportional to the 
scattering lengths in the F = and F = 2 channels, 
respectively. The hopping is assumed to be generally 
anisotropic in two spatial directions, i.e., 



U 



t for (ij) || x 
Xt for (ij) || y 



< A < 1. 



(2) 



Although our main interest will be in the behavior of the 
two-dimensional model, we will also make a few com- 
ments about the one-dimensional case which formally 
corresponds to A = 0. 

We will be also interested in the effect of the exter- 
nal magnetic field. Since the total magnetization in cold 
atom experiments has very long relaxation time, the pri- 
mary effect of the external field is given by the quadratic 
Zeeman term: 



Hp. 



(3) 



At quarter filling (one particle per site), and in the 
limit of strong on-site repulsion <C Uo,U2 the charge 
degrees of freedom are strongly gapped and the sys- 
tem can be approximately described by an effective spin 
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FIG. 1. Square lattice with the anisotropic hopping consid- 
ered in this paper. The hopping amplitudes are t and At along 
the horizontal and vertical bonds, respectively. 



Hamiltonian, which can be conveniently written in the 
following formii2~— 

#spin = E Jl,ijFi b ^j b ~ E JlM^i^p ( 4 ) 



l<a<fa<5 

(ij) 



l<a<5 

(ij) 



where the 4 x 4 matrices T a and r afc = ±[T a , T b ] arc the 
generators of the 5C/(4) Lie algebra. The operators T a 
form a vector representation of the Sp(4) group, and T ab 
form an adjoint representation of Sp(4), so the Hamilto- 
nian (j4j is explicitly Sp(4)-mvariant. 

In the second order of the perturbation theory in t, the 
exchange constants 3\ i2 are given by: 



■h 



a +2 

= -(- 

X} 4\U ' U 2 J' ~" VJ 4\U Q U 2 



1 /t 2 t 2 
- -(Ji 4- Ji 



J2,ij — — ' 



(5) 



The operators T a , r ab can be expressed in terms of four 
Schwinger bosons b a , 1 < a < 4, satisfying the constraint 
b\b a = 1 at each site: effectively one can just replace the 
operators c CT) j by b a .i in the definition of T in ((4]). Doing 
so, one arrives at the Hamiltonian of the formic 



— Ji j kJ^ Kij Jij QljQij, 



spin — ^ 13 

(ij) 



(6) 



Qij — b a ^J a pbp^ 



where J is the antisymmetric matrix that has the fol- 
lowing properties: 



J T = J f = -J,J 2 = -1, 



ab\T 



j'r a j = (r a ) , jT ab j = ~(r ab ) 

One specific representation of the matrices introduced 
above is given byJ^ 

T a = a a ® a z , a = 1,2, 3, L 4 = 1 ® a x , 

T 5 = l®a v , J = i<7 y ®a x 1 (7) 

where a a are the Pauli matrices. The Sp(A) group may 
be viewed as a group of unitary 4x4 matrices U that 
satisfy the condition U T JU = J . 

The couplings J, J' in ^ are given by: 



_tl(u 2 -u ) 



2/ 2 - 



U U 2 

and are assumed to be positive; in terms of the atomic 

3 
2 

u 2 >u Q > 0. 



spin- 1 system this corresponds to the assumption 



The Hamiltonian in the form ([6]) can be easily generalized 
to the case of an even number N of bosonic flavors b a , a € 
[1, N] and the local hardcore constraint for the Schwinger 
bosons is generalized by 

b^ba = n c , 
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with the number n c playing the role of the "spin 
magnitude" J£ 

The Sp(N) symmetry of the Hamiltonian is enlarged 
to SU(N) at the point J = 0, where the two-site 
Hamiltonian becomes a permutation operator of two N- 
component objects. Since the lattice is bipartite, the en- 
largement of symmetry to SU(N) happens also at J' = 
point J2 r 15 i 17 The latter point J' = corresponds to a 
SU(N) antiferromagnet where spins transform according 
to the fundamental representations of SU(N) on sublat- 
tice A and according to the conjugate representation on 
sublattice B. In the following we will refer to this point as 
the staggered SU(N) antiferromagnetic point. The other 
SU(N) point J = 0, where spins are in the fundamen- 
tal representations of SU(N) on each site, corresponds 
to the exactly solvable Uimin-Lai-Sutherland model in 
one dimension^ and we will call it the uniform SU (N) 
antiferromagnetic point. 

Our strategy will be to use the staggered SU (N) anti- 
ferromagnetic point J' = (i.e., U2 — > 00) as the starting 
point to construct the effective low-energy field theory. 
First of all, we make a unitary transformatio n 15 ! 17 on 
one sublattice, 

S n 1 ^ J f S n J, S e {f a , f Qb }, n € sublattice B, (9) 

that effectively interchanges the operators Q and K in the 
Hamiltonian ([5]). Further, we use the usual coherent state 
path integral formalism, passing from the bosonic opera- 
tors b atn to the corresponding c-number lattice variables 
b n . It is easy to sec that at the mean-field level both 
terms in the Hamiltonian © are simultaneously min- 
imized for a uniform distribution of b n , provided that 
J, J' > 0. Thus, in the parameter region J, J' > in 
© one may expect the physics to be rather different 
from that found in Sp(N) models describing geometri- 
cally frustrated systems^ 

In terms of b n , the Euclidean action on the lattice takes 
the form Ai a t = J dr£i at , with the Lagrangian: 

Aat = VnK ■ d T b n 

n 

+ ( J '\ b n ■ JK>? - J\K ■ bn>\ 2 )• (10) 

(rm ; ) 

In a standard manner, we then split the field b into the 
smooth and staggered components z n , ip n : 

K = \/n~ c (z n + r) n i/) n ), (11) 

where r\ n takes values of ±1 on A and B sublattices, 
respectively, and the constraints 

|z| 2 + |V| 2 = l, ^-z*+z-^* =0 (12) 

are implied. One can expect that the magnitude of the 
staggered component xjj that corresponds to ferromag- 
netic fluctuations, will be much smaller than that of z. 



The unitary transformation © is a necessary step: for 
positive J' one cannot start from the uniform SU (N) an- 
tiferromagnetic point J = 0, since no reasonable choice 
of smooth fields is possible. It has to be remarked, how- 
ever, that our choice of smooth fields becomes poor in 
the vicinity of the point J = that has a much higher 
degeneracy of the mean-field ground state. One may thus 
expect that the resulting effective field theory is not reli- 
able close to the uniform SU(N) antiferromagnetic point. 

Passing to the continuum and making the gradient ex- 
pansion, while retaining only up to quadratic terms in 
tp and neglecting its derivatives, one readily obtains the 
Euclidean action in the form A = -4o+-4i n t+-4t p, where 
A® corresponds to J' = 0: 

A = V\n 2 c J dr J d d x{-^-{^* ■ d T z - ip ■ d T z*) 
+ J(\d k z\ 2 -\z*-d k z\ 2 ) 

+ u{d-i + \)(\M 2 -\r -A 2 ) 

+ Ml (</> ■ z* + r ■ z) + M2 (| Z | 2 + M 2 - 1)}. (13) 

The term .Atop contains the topological phase 
contribution ) 18 ' 21 ^ 

AtopN =n c dr rj n z* ■ d T z n , (14) 

** n 

and the perturbation Ai n t is determined by the deviation 
J' from the staggered antiferromagnetic SU(4) point: 

A^ = J'n 2 c V\ J dr J d d x\\z-d k z\ 2 +A{d-l+X)\^-z\ 2 y 

(15) 

Here and throughout the paper we use the notation 

z = Jz. (16) 

In the above expressions, d — 1 or 2 is the spatial dimen- 
sion, the index k = l,...,d labels spatial coordinates, 
and the lattice constant a and the Planck constant has 
been set to unity for convenience. The factor vA comes 
from rescaling one of the coordinates to compensate for 
the anisotropy of interactions (for d = 1 one has to set 
effectively A = 1), and /i lj2 are the Lagrange multipliers 
ensuring the constraints. 

Integrating out the staggered component ij) can be eas- 
ily performed (see Appendix lAl for details), and one ar- 
rives at the following effective action for the complex unit 
vector field z: 




Here A is the ultraviolet momentum cutoff, x a — 
Ur^/d — 1 + A is the rescaled imaginary time coordi- 
nate, V u — d u — iAfj, is the gauge covariant derivative, 
and A/_ t — —i(z* ■ d^z) is the gauge field. It is worth 
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noting that z ■ V^z 



z ■ d^z since z ■ z 



0. The bare 



values of the coupling constants in (fTTj) are given by the 
following expressions: 

mm mi i f . d — li V 2 

9i = 9 2 



lr d - 1 -i ] 
n r I A I 



gr = -{l + JU')9?\ g~^ = (J/J')g 2 °\ (18) 

In particular, note the different signs of gl and g%. The 
first two terms in the action (|17l) constitute the fa- 
miliar action of the CP N ^ X model j22r^I that has been 
extensively studied as an effective theory for SU{N) 
antiferromagnet o 18 ' 22 . The third and fourth terms 
are proportional to J' and thus represent perturbation 
caused by the deviation from the SU(N) staggered an- 
tiferromagnetic point. The presence of those terms has 
been noticed by Qi and Xu?i£ but they have been ne- 
glected since they seem to be irrelevant. In the next 
section, we will show that those Sp(N) terms are gen- 
erally only marginally irrelevant, and can drive a phase 
transition. 

Here a remark is in order: in the action above, for the 
2d case we have effectively removed the lattice anisotropy 
by rescaling one of the coordinates. Due to the Sp(A) 
symmetry of the problem, the remaining perturbations 
that break the 90 degree rotation symmetry of the lat- 
tice appear only in higher orders in field derivatives: the 
lowest-order terms of this type have the form / M |z*2? 2 2i| 2 
and f f j,(zT> fJ ,z)(z*Df l z*) + c.c., with f x ^ f y . Such terms 
are less relevant than those taken into account in the 
action (fTTj) and thus will be neglected. 

The properties of the CP N ^ model are well under- 
stood: in the absence of the topological term ^4 top given 
by ([14")) , it is always disordered in d = 1, and in d = 2 the 
long range order appears below a certain critical value 
of the effective coupling ] 25 ' 26 This critical value depends 
on N, and from the numerical work 2 ^— it is known that 
the two-dimensional CP N ~ X model on a square lattice is 
disordered for N/n c > 5. 

In the disordered phase the field z acquires a finite 
mass, and a kinetic term for the gauge field is dynam- 
ically generated^ It is also well known that the topo- 
logical term becomes crucially important in the disor- 
dered phase j 18 ' 21 ' 22 particularly, it leads to a spontaneous 
dimerization in d — 1 for odd n c (except for N = 2 which 
is special: in that case the system remains gapless and 
translationally invariant in a wide g ranged—), and in 
d = 2 the disordered phase gets spontaneously dimer- 
ized in different patterns depending on the value of (n c 
mod 4). The "disordered" phase thus acquires valence 
bond solid (VBS) order connected to the broken transla- 
tional invariance. For the Sp(4) case, parent Hamiltoni- 
ans with exact ground states of the VBS type have been 
constructed recently^ 5 - 

An effective theory for the Sp(N) Heisenberg model 
in a form similar to (JT7J has been obtained by Kataoka 
et al. 36 However, our result differs from that of Rcf. 3G 
in one important respect: the last two terms in (1171) . 
proportional to the "perturbation" J', explicitly break 



the Lorentz invariance, while in the theory of Ref. [36| 
the Lorentz invariance is retained even in the presence 
of the "perturbation" . By a simple classical linear exci- 
tation analysis of the initial lattice action (ITU)) one can 
obtain (N — 1) Goldstone modes ("spin waves"), hav- 
ing the velocities v± = v 2 = ■ ■ ■ — Uzv-2 = 1 and 
vn-i = 1 + J'/J (in units of 2Jy/d), see Appendix [B] 
for details. Our effective theory (fl~7l) yields (N — 2) 
modes with the velocity u\ = y^y and one mode with 

the velocity u 2 = Uiy(l + p)/(l — k), where 7 = 91/92, 
P = 92/52, and k = —91/91. After substituting the bare 
values of Eq. (|18l) , this is in a perfect agreement with the 
spin wave calculation, while the theory of Ref. |36| yields 
the same velocity v = 1 for all three modes. 

For N = 4, the contribution of the quadratic Zeeman 
field © takes the following form: 



A z = 



A d+i 



dr \ d d x(|zi| 2 + |z 4 | 2 ), 



with the bare "mass" value given by 
ml = 2q/{Jgf ) ). 



(19) 



(20) 



For any finite q, the symmetry of the model is reduced 
from Sp{4) to SU{2) x SU(2*p.. If q is large enough, 
the effective theory reduces to that of a two-component 
complex field, i.e., to the CP 1 model. 



III. ONE-LOOP RENORMALIZATION GROUP 
ANALYSIS AT ZERO FIELD 

Consider first the case when the external field is absent. 
To understand the role of the Sp{N) terms in the action 
(|17p. we have to analyze their behavior under renormal- 
ization. Renormalization group (RG) equations for spin 
liquids described by a Lorentz-invariant low-energy field 
theory with SU(N) and Sp(N) symmetries have been 
studied recently 3 -! by means of the fermionic large- N for- 
mulation. Our effective theory (flTI) does not possess the 
Lorentz invariance. We write down one-loop RG equa- 
tions for the model (fT7|) . using Polyakov's background 
field method^ The details of the derivation can be found 
in Appendix [C] It is convenient to define the following 
parameters: 



91 



7=—: V = 2C d ^g 1 g 2 , 
92 



9i 
91 ' 



P 



92 

92 : 



(21) 



where C d = nS d / {2ir) d+1 and S d = 2n d / 2 /T{d/2) is the 
surface of a d-dimcnsional sphere. The minus sign has 
been introduced in k, to compensate for the negative 
initial value of g\ in (|18p . The physical meaning of the 
couplings (f2Tj) will be clarified below. Their bare values 
are: 



9 (0) = 2C d9 [°\ 



,(0) 



J' 



J+J' 



7 (0) = 1, 

' (0) = 7 



(22) 
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FIG. 2. A typical flow of the couplings in the disordered 
(VBS) phase in d — 2. The inset shows the "U-turn" behav- 
ior. 



The resulting RG equations can be conveniently written 
down in the following form: 

y = (l-d)y + y 2 {N-l 

7 = j/7(k + p), (23) 



k = y\n 2 -(N -3)k-1 + 



1 - K\!/2 



1+P 



, = s 3), -(i±|)" 2 }, 

where a dot denotes the derivative d/dl = — A(d/dA) 
with respect to the scale variable. 

For the staggered antiferromagnetic SU(N) point J' = 
we have k 1 - ' = 0, p^ = 0, and the above equations re- 
duce to the single equation for the coupling g = y/(2Cd) 
of the CP^ -1 model in d spatial dimensions. For d = 2 
this model is ordered (g renormalizes to zero), if the ratio 
n c /N is above a certain critical valued equations (j2"3"|) 
estimate this critical value as follows: 



K/AOcrit = (1 + 1/X) 1/2 /(2tt). 



(24) 



On the isotropic (A = 1) square lattice, this yields 
(n c /N)„ = (2TT 2 )- 1 / 2 ~ 0.225, which agrees qualita- 
tively with the value of 0.19 obtained by a mean-field 
large- ./V solution^ and with the numerical studies^— 
suggesting that the system has no Neel order for N/ n c > 
5. 

For nonzero J', we have studied the equations (|23p nu- 
merically for different values of the lattice anisotropy A 
and the Sp(4) perturbation J'. In the two-dimensional 
case (d = 2), they exhibit two different characteristic flow 
patterns: In type I, y flows to zero as I — > oo, while the 
other couplings flow to some constant values. This type 
of flow corresponds to the Neel-ordered phase, and the 
Lorentz invariance remains broken: there are two differ- 
ent velocities u% — */7 and u-i = uiy/(l + /?)/(! — k). 
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FIG. 3. A schematic phase diagram of the Sp(4) Heisenberg 
model Q on a two-dimensional rectangular lattice in absence 
of the quadratic Zeeman field, obtained from the analysis of 
the RG equations (|23|l . The shaded region close to the uni- 
form SU(4) antiferromagnetic point J = indicates that the 
applicability of our effective theory in that domain is ques- 
tionable. 



In type II, y flows to infinity at a certain scale I = Iq 
as y ~ l/(^o — I), while 7 flows to a constant, and both p 
and k flow to zero as p, k ~ (Zo — Z) 1_3 / 2Ar . This behavior 
corresponds to a disordered phase, the Lorentz invari- 
ance is restored (the perturbation terms in (fl~7f flow to 
zero), so in the disordered phase the system is again ef- 
fectively described by the CP^ -1 model, albeit with a 
renormalized velocity u = y^y and the effective coupling 
g = y/(2Cd=2)- In this phase, the presence of a topolog- 
ical term induces dimerization,— so this regime in fact 
corresponds to a valence bond solid (VBS) state. 

It is worth noting that when y flows to infinity in d — 2, 
it exhibits a two-stage "U-turn" behavior as shown in Fig. 
[2] at the initial stage of the flow, up to a certain scale 
I = I*, g decreases and only later starts growing till it 
explodes at I = Iq. The scale I* increases in the vicinity 
of the phase transition line (see below). This behavior 
is reminiscent of a double-scale behavior observed in the 
SO(3) model^ as well as in the CP W_1 model with a 
massive gauge field.— 

If at J' = we are in the VBS phase (i.e., n c /N is 
below the critical value (|24p). then increasing k^- ' cx J' 
beyond some threshold k c leads to a transition to the Neel 
phase. On the anisotropic (rectangular) lattice, with the 
increasing anisotropy (deviation of A from 1) the transi- 
tion point k c shifts towards higher values. The resulting 
phase diagram is shown in Fig. [3] Thus, in two dimen- 
sions the Sp(N) perturbation terms in (fTT|) are danger- 
ously irrelevant and can drive the phase transition be- 
tween the disordered (VBS) and Neel phase. 

In one dimension, y always flows to infinity indicating 
that the system is dimerized in the entire range of < 
K < 1, in line with the numerical results.— Curiously, 
in the close vicinity of the uniform SU(N) point k = 1 
(J' ^> J), the coupling y again exhibits the "U-turn" 
behavior as described above, and the intermediate scale 
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I* seems to diverge as J/ J' —> 0. This agrees with the 
fact the uniform SU (N) antiferromagnet k — 1 is gapless 
in d = 1 (it corresponds to the exactly solvable Uimin- 
Lai-Sutherland (ULS) modeli2). 

With the present approach, we are not able to detect 
any tendency towards a transition to the VBS phase with 
increasing J' / J for the case of isotropic square lattice 
(line A = 1). One has to keep in mind that our construc- 
tion of smooth fields becomes increasingly inadequate as 
J — » 0; however, one can argue that the theory still re- 
mains valid at the energy scales of less than order J. 
Several numerical results using exact diagonalization on 
small 2d clusters^ series expansions, 43 and density ma- 
trix renormalization group (DMRG) on a ladder— sug- 
gest that the uniform SU(4) antiferromagnet (J = 0, 
A = 1) is in a VBS phase with the plaquette-type dimcr- 
ization order. At the same time, theoretical studies advo- 
cate different scenarios for the uniform SU (N) antifcrro- 
magnetic point: in a recent work based on the Majorana 
fermion representation of spin-orbital operators^ the ex- 
istence of a Zi spin-orbital liquid state with emergent 
nodal fermions has been proposed for N = 4; other stud- 
ies based on Schwinger-boson representations 4 ^^ and 
exact diagonalization for the SU(3) case 4 ^ suggest that 
at this point the ground state has the Neel-type N- 
sublattice order, which may be viewed as order at the 
wavevector (2tt/N,2tt/N). The question about the cor- 
rect ground state around the point A = 1, J = is thus 
still open. Further, our result shown in Fig. [3] indicates 
that the VBS phase present at small A has the tendency 
to shrink with increasing J'/ J. This makes plausible 
to assume that, even if the point A = 1, J = is in 
the VBS state, this phase should be different from the 
VBS phase at small A. Another argument in favor of 
this scenario is the following: consider the point J = 0, 
A = which describes uncoupled ULS chains. Each chain 
is gapless, with zero gap at wave vectors k = 2t:m/N, 
—N/2 < m < N/2. Switching on weak interaction A 
between the chains may be expected to lead to an imme- 
diate ordering at those wave vectors, while switching on 
weak J leads to a VBS state. 



IV. THE EFFECT OF QUADRATIC ZEEMAN 
FIELD IN THE 5p(4) HEISENBERG MODEL 



Let us now add the quadratic Zeeman field term (| L9[) 
to the effective model (TiT]) with N = 4. Now the first 
and the fourth field components become massive and can 
be integrated out at once. We decompose the field into 
the background part (p and the "fast" massive part x as 
follows: 



z = <p^/T- \x\- + x, 

tp = (0,ipi,<P2,0), X 



(Xi, o,o X4 ) 



(25) 



where tp* ■ tp = 1. One can straightforwardly show that 
for the two-component unit complex vector field the fol- 
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FIG. 4. A schematic phase diagram of the S'p(4) Heisen- 
berg model Q on a two-dimensional rectangular lattice, in 
presence of a finite quadratic Zeeman field q = Jqo/2. The 
transition line is determined by Eq. (|3ip with g c = n; it moves 
towards higher A with decreasing q and becomes flat at q = 0. 
The shaded region close to the uniform 5(7(4) antiferromag- 
netic point J — indicates that the applicability of our effec- 
tive theory in that domain cannot be trusted. 



lowing identity holds: 

|£ • d^\ 2 = \d, V \ 2 - \tp* ■ dM 2 = WM 2 - (26) 

Thus, integrating out Xi one obtains the familiar CP 1 
model that is equivalent to the 0(3) nonlinear sigma 
model (NLSM) and has been extensively used for a de- 
scription of Heisenberg spin systems. The topological 
term (Ti"4"|) is retained. The resulting action takes the 
form: 



A CP i [tp] 



A 



d-l 



-i( \DoV>\ 2 D k z\ 



<)2 



J+Aop[¥>]. 



The renormalized couplings gl 2 are given by the formu- 
las: 



1 1 



1 



^ = ^ + r7nT- 4 Si 0) ^M(- + ^), a =1,2, 



y a 9a 9a 

where: 



1 



9a 9a 



(28) 



A 



1— d r oo 



dko 



A 2J (2^+1 ./-oo u A fcM ^ + fc 2 + A 2: 



d d k 



_ A 2 (o) 2 2q 
lo = =9i 'm = —. 

In one and two dimensions one has respectively: 



(29) 



(30) 



The CP 1 model with the topological phase angle 6 = n 
has a disordering transition into a gapped dimerized 
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FIG. 5. A schematic phase diagram of the Sp(4) Heisenberg 
model Q in one dimension, in presence of a finite quadratic 
Zeeman field q. The transition boundary (solid line) obtained 
from the present CP 1 model approach, Eq. (|31H for d — 1 with 
g c = 2.1, is compared to the result of Ref. [la (filled circles) 
obtained by mapping to an effective spin-i zigzag chain. The 



parameters on the axes are given by Eq. ([32} • The inset shows 
the same transition boundary in the full range of k in terms 
of q = 2q/J. 



(VBS) phase above a certain critical value g c of the effec- 
tive coupling g c ff = \J g\g\, both in one and two spatial 
dimensions. For g c g < g c , the model is gapless, is long- 
range ordered in d = 2 and has quasi-long-range order 
in d = 1. Thus, the line of phase transition between the 
Neel and VBS phases is given by: 



9\9i = 9c 



(31) 



Although the exact value of g c is not known, one may ex- 
pect that Eq. pip will qualitatively reproduce the tran- 
sition line. 

Fig. @] shows the result for the case of two dimensions, 
where we have used g c = it (which is just the extrapo- 
lation of the large- TV result g c = down to the case 
N = 2). One can see that the curvature of the phase 
boundary agrees with the results of the previous sec- 
tion obtained in absence of the field. Again, we can- 
not see any tendency toward the VBS order at the uni- 
form SU(N) antiferromagnetic point on a square lattice 
(J = 0, A = l). 

In the one-dimensional case, one can do better and ex- 
tract the value of g c from the comparison with the tran- 
sition in an antiferromagnetic spin-^ zigzag chain. Ro- 
driguez et al J£ have used a direct mapping of the original 
fermionic model ([lj onto an effective spin-^ chain with 
nearest- and next-nearest-neighbor exchange couplings j\ 
and j2, respectively. The constants ji 2 were obtained as 
series in the perturbation parameter 1/Q, defined as fol- 
lows: 



q{U 2 + U ) _ 2q(l - K ) 



J' 



2t 2 



Jk(1 — k) ' 



J+J' 



(32) 



Further, by using the value js/ji ~ 0.24 for the tran- 
sition point into the dimerized phase, which is known 



from numerical studies^ in Ref. [l6| an estimate for the 
transition line in the (1 — K, Q) plane has been obtained 
that compared very well with the numerical results for 
the original spin-| fermionic model. 

In our approach, we can try and fix the value of g c 
(which is a sole fitting parameter in our theory, for the 
entire line of transition points in the (k, q) space) by com- 
paring the output of our Eq. ([3T|) to the results of Ref. 
[la . Fig. [5] shows the transition line obtained from Eq. 
([3l"T) for d = 1 with g c = 8.5 in comparison to the curve 
obtained in Ref. [lfl One can see that the above value 
of g c yields a good agreement close to the SU(N) anti- 
ferromagnetic point n — 0. So, as a byproduct of our 
studies of the Sp{4) Heisenberg model, we obtain an in- 
dependent estimate of the critical coupling value for the 
Id CP 1 model (or, alternatively, the 0(3) NLSM) at the 
topological angle 9 = n: 



9, 



CP 1 



1 



79, 



NLSM 



(2.1 ±0.1). 



(33) 



In the vicinity of the Sutherland point J = our de- 
scription breaks down; this can be seen already from 
the fact that the transition line goes to a finite value 
of qo = 2q/ J at J — ► (see the inset of Fig. [SJ, while the 
main scale in this limit is J' 3> J, so the critical value of 
go should diverge as (1 — k) _1 in this limit. 



V. SUMMARY 

We have considered the model ([T]) describing spin-| 
fcrmions in a spatially anisotropic optical lattice shown 
in Fig. [T] at quarter filling in the Mott limit of the on- 
site repulsion constants £/o,2 being much larger than the 
hopping amplitudes t. In this limit the charge degrees of 
freedom have a large gap, and the system can be mapped 
to the so-called Sp(A) Heisenberg spin model. 

We have studied its large- N generalization, the Sp(N) 
spin model, with the help of the field-theoretical ap- 
proach constructed in the vicinity of the staggered 
SU(N) antiferromagnetic point. It is shown that the 
effective field theory corresponds to the Sp(N) extension 
of the CP^ -1 model, with the Lorentz invariance gener- 
ically broken by the Sp(N) terms that break the SU(N) 
symmetry. For this effective field theory, we have ob- 
tained the renormalization group equations to one-loop 
order and have shown that although in the vicinity of 
the staggered SU (N) antiferromagnetic point the Sp(N) 
terms are seemingly irrelevant, their presence leads to a 
considerable renormalization of the SU(N) part of the 
action, thus driving the transition between the phase 
with a long-range Neel-type order and the magnetically 
disordered valence bond solid (VBS) phase. We would 
like to note that solutions of the renormalization group 
equations in the disordered phase exhibit a characteris- 
tic double-scale behavior close to the Neel- VBS transi- 
tion boundary. Such a behavior is reminiscent to that 
encountered in other frustrated models i 40 ' 41 and is also 
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expecte d ' 50 in the framework of the deconfined critical- 
ity conjectured 

In addition to the Sp(N) perturbation, we have 
also analyzed the effect of the external magnetic field 
(quadratic Zeeman effect) and established the qualita- 
tive form of the phase diagrams in one and two spatial 
dimensions. For the physical case N = 4, at large val- 
ues of the quadratic Zeeman field the effective theory re- 
duces to CP 1 model describing an isotropic Heisenberg 
antiferromagnet with a pseudospin i. Its ground state 
in two dimensions is always in the long-range ordered 
(Neel) phase for the pseudospin- i, and when the field 
is decreased, this state either adiabatically evolves into 
the Neel phase of spin-| fermions (with the reduced Neel 
order—) or undergoes a phase transition into the VBS 
state. In one dimension, there is a phase transition of the 
Berezinskii-Kosterlitz-Thouless type that corresponds to 
the spontaneous dimerization transition in a frustrated 
spin-i chain with next-nearest neighbor exchange.— As 
a byproduct, by fitting our results to the available numer- 
ical data,— we have obtained an estimate for the critical 
coupling of the CP 1 model with the 9 = tt topological 
term in (1 + 1) dimensions. 

One last word of caution is in order: since our effective 
theory is constructed around the staggered SU(N) an- 
tiferromagnetic point J' = 0, it is not expected to work 
well close to the other, uniform antiferromagnetic SU (N) 
point J = 0. For that reason, we cannot exclude the 
presence of another phase transition to the VBS phase 
in some region around the uniform SU(N) point on the 
isotropic lattice (J = 0, A = 1), as suggested in Ref. 
IT7I . Constructing an effective field theory describing the 
vicinity of the uniform antiferromagnetic SU (N) point 
remains a challenge for the future work. 
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Appendix A: To the derivation of the effective 
Sp(N) field theory 

We integrate out the staggered field if> as well as the 
lagrange multipliers from the effective action A given 
by Eqs. (fT3|) - (p~5j) . The equation of motion for ip has the 
following form: 

Mip + d T z + fiiz + H2i/> = 0, (Al) 

where the matrix M is given by 

M = c(l-n + eP), Sl afi = z a z* p , P aP = rjp. (A2) 



Here c = 4J(<f-l + A), e = J'/ J, and z is defined by (fT6i 
From the equation of motion for z one can conclude that 
[12 is of the order of a second derivative of z and thus can 
be neglected. 

Since we have assumed <C 1, one can exploit the 
approximately holding identities P 2 ~ P, SI 2 ~ SI, SIP ~ 
PSl ~ 0, Mz ~ 0, Slz* ~ 0, etc., and their derivates such 
as 

(1 - ft - P)z ~ (1 - SI - P)z* ~ 0, 

(1 - SI- P)(l - n + eP) ~ 1 - n - P. (A3) 

Applying ([AT?]) to (fATjl . we get /xi ~ -(z*d T z), and 

P){ctp + d T z) =0. (A4) 

From the last equation one concludes that 

tP = (-d T z + y)/c, (A5) 

where y satisfies (1 — SI — P)y = 0. Expanding y in the 
system of mutually orthogonal vectors (z, z* , e a ): 

N 

y = wiz + w 2 z* + ^ ro « e ». 

a— 3 

and applying (1 — SI — P) to y, one readily obtains 

y = W\Z + W2Z* . (A6) 
Substituting the above result for y back into (|A1|) yields 

w 2 ^-^—(z-d T z), (A7) 
1 + e 

and further, using the constraint ip ■ z* ■ tj) = 0, one 
obtains for the coefficient w\\ 

wi + wl = 2d T z ■ z*. (A8) 

Collecting Eqs. (IA5|) - (IA8|) . one obtains the resulting ex- 
pression for ip : 

if; = — ( —d T z + —— — (z ■ d T z)z* + wiz) . (A9) 
c \ 1 + e ) 

Substituting the above expression back into the action 
A[z. ip], one finally obtains the effective action in the form 

Appendix B: Linear excitation analysis for the 
lattice Sp(N) model 

Here we provide the classical linear excitation analy- 
sis for the lattice Lagrangian (fTU|). Let us choose the 
classical ground state as z — (1,0,. ..,0), then small 
deviations from this ground state can be written as 
Zn = (V 1 ~ IVnl 2 , <Pn), where ip n = (ip ln , <p N -^ n ) 
is a (N — l)-component complex vector. Expanding in ip, 
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and keeping only up to quadratic terms, we obtain the 
Lagrangian: 

C = -i^TjntPn ■ dttPn ~ Zj2(J\V>n\ 2 + J'\p N -l,n\ 2 ) 



)},(B1) 



(nn 1 ) 



where Z = 2d is the lattice coordination number, and for 
the sake of clarity we have switched back to real time t 
and set the lattice to be spatially isotropic (A = 1). After 
the standard Fourier transform, the equations of motion 
are obtained as id t p a (k) + F a (k)ip a (k) = 0, where the 
functions F a are given by: 

d 

F a (fc) = 2J^(l + cosfc^), a=l,...,JV-2 



F N _x(k) = 2{J + J')^( 1 + cosfc p 



The dispersions ui a (k) of linear modes ("spin waves") 
are thus determined simply by the relation w„(fe) = 
F a (k)F a (k + 7r), which in the limit k — > yields the 
spin wave velocities: 



a = 2jVd, a = 1, . 
i = 2(J + J')Vd. 



., N- 2, 



v N 



(B3) 

Those velocities, obtained by a spin-wave- type lattice cal- 
culation, perfectly agree with the velocities obtained from 
our effective continuum action (fT7|). 

As a side remark, it is worthwhile to note that in pres- 
ence of the quadratic Zeeman field q (see ([3])) the spin 
wave velocities do not change with the increase of q, coun- 
terintuitively to the common knowledge that the spin 
wave velocity is linearly proportional to the spin magni- 
tude S (and S effectively decreases from | at q = to 
S = h at q = oo, for the physical case JV" = 4). For 
N = 4, the effect of QZE is to make two out of three spin 
wave modes massive, but it docs not touch the velocities 
(which, for gapped modes, take the meaning of limiting 
velocities). On the other hand, when one changes the 
spin-2 channel interaction J7 2 from +oo to Uq (which cor- 
responds to the path from the staggered to the uniform 
antiferromagnetic SU(4) points), velocities vi : 2 decrease 
and tend to zero as Vi — » Uq, while the remaining ve- 
locity i>3 increases. Particularly, V3 is twice as large at 
the uniform SU(A) point as it is at the staggered SU(4) 
one, ^3(1/2 = Uq)/vz{U2 = 00) = 2. Physically, soft- 
ening of v\ } 2 reflects the increase of frustration on the 
way from the staggered to the uniform antiferromagnetic 
SU(A) point. 



Appendix C: RG equations for the Sp(N) model 

We derive here the RG equations for our Sp(N) ef- 
fective action without Lorentz invariance (I17p . using the 



Polyakov background field method. 3 - We start by split- 
ting the fields z a and A^ into the background ("slow") 
fields (p a , A^, and the fluctuation ("fast") parts Xa , 

N-l 



0=1 



Ay, A^ 



(CI) 

where {ip, e a } form a set of mutually orthogonal com- 
plex unit vectors. Since the "tilded" slow field ip = J<p 
satisfies the condition ip ■ <p — 0, we can expand it as 



^2<Pae* a . 



(C2) 



We will not need any explicit expansion of the "tilded" 
fast field x, because we will be able to avoid its presence 
by using the identities x ■ y = —(x-y), x x = x ■ x. We 



will use the notation X>„ = 



- iA,j, and = - iA^. 



(B2) The derivatives of {e a (x)} can be written in the form 



B 



Oct . 



b;°<p, 

-B™<p, 



(C3) 



where B^f = -{B^f = e fj ■ e a , e = <p. The quantity 
<p* ■ d^ip can be eventually identified with A^. 
There is a substantial freedom in the choice of the lo- 
cal basis {e a (x)}, which one can use in order to elim- 
inate B^ b (but not B^°). Indeed, under a local uni- 
tary rotation e a 1— > U a be-b the (TV — 1) x (N — 1) matrix 
b m = {Bf} transforms as i-> {dpU)U^ + UB^lP. 
Thus, to eliminate B^, one has to solve the equation 
Bp = (d/j,U^)U. Comparing that to (|C3[) . it is easy to 
see that setting U ab = (e£) a does the desired job. Fi- 
nally, multiplying the rotation matrix by a phase factor, 

U i->- U exp I — i j x Ap(x')dx'^, we can eliminate the 

U(l) gauge field A^ from the expression for D^x as weu J 
so that one effectively replaces D^x by d t _ l Xa,e a +XaB'jf(p. 



We substitute the ansatz (|Cip into the action (| 1 T[) . and 
make use of the trick described above to simplify D^x- 
The "fast" component of the gauge field a M enters the 
action in a quadratic way; integrating it out yields: 



i(x-(D^)* -X* -Dpcp). 



(C4) 



Plugging this expression back into the action, one obtains 
after some algebra the new effective action in the form 

Aes[z] = A e ff[p] + A int , with 



-^int — 



A 



+ X*aXb 

1 



d d ^xUd, x :)(d, Xb )( 6 -^+ 



—B° a (B° h 
9n 



—\dm- 

1 



9 ix 



(B° b y + ^(D^ a y(D^ b )}\. (C5) 



Here for the sake of brevity we have introduced the fol- 
lowing notation: 

9» = 92 + (gi - 52)60**! %, = §2 + (gi - 92)S 0f j,, (C6) 
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so that g^ = g x , g^ = g x for /i = 0, and g M = g 2 , 5p = 92 
for /i ^ 0. 

Doing the final step of integrating out the fluctuations 
field x, it is convenient to make use of the following for- 
mula: for a matrix of the form 



M = xt + yP, P ab = $* a Vb, 



(C7) 



the fluctuation, takes the form: 

AA = C d A d - 1 dl J d d+1 x{\D„<p\ 



v 5m 9v> V7 V V7' 
V^mV — - — — — 

V a„ a, J V */y .fiy 



(CIO) 



\fl> 9». 



5m 7 W7 V7' 
where we have introduced the shorthand notation 



where <p*</5 a = 1, its inverse can be explicitly written 
down as: 



1. 



y 



M- 1 = -1- 

x x(x + y) 



P. 



(C8) 



With the help of this identity, the "fast" field %, contain- 
ing the Fourier components with momenta in the interval 
[A, A(l + dl)], can be easily integrated out. A typical in- 
tegral over the momentum (fco, k) has the form: 



(2tt 



id+l 



dko 



d d k =Ad - 1 c ±dl 

fe|=A(i-dO k o + 7& 2 V7 



(C9) 

where we have denoted d — itSd/ '{2ir) d+1 and Sd = 
27r rf/2 /r((i/2) is the surface of a rf-dimensional sphere. 
The correction AA to the action _4 c ff[c£>], coming from 



9i , 

7 = —, 9i 

92 



9i + 9i 



I l 92+ 92 

7 =9l — : 

9292 



(Cll) 



and have again used the notation (|C6p . From (|C10|) . the 
RG equations for the couplings are readily obtained in 
the form 

df/dl = (l-d)f-2C d p f (f), 

where / G {gi, g 2 , g\, §2}, and the beta functions are 
given by: 



U/^Voi / 51 v 7 ' 



V7 v 5i 

P 92 =9l{^~(N-l)?± 
U/7V09 52 



(C12) 



92 V7 



V7 v 52 

L ^ V 01 / \/7' \gi 01 / J 



% = . 9 1 2 {^(^ - (AT - 2)2*) + ^ + M) }. 

L V7 V .92 32 7 V7 v .92 52 7 J 

Rewriting the above system in variables (l2"Tj) , one finally 
obtains the RG equations in the form (|23l) . 
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